Alternative face models for 3D face registration
نویسندگان
چکیده
3D has become an important modality for face biometrics. The accuracy of a 3D face recognition system depends on a correct registration that aligns the facial surfaces and makes a comparison possible. The best results obtained so far use a one-to-all registration approach, which means each new facial surface is registered to all faces in the gallery, at a great computational cost. We explore the approach of registering the new facial surface to an average face model (AFM), which automatically establishes correspondence to the pre-registered gallery faces. Going one step further, we propose that using a couple of well-selected AFMs can trade-off computation time with accuracy. Drawing on cognitive justifications, we propose to employ category-specific alternative average face models for registration, which is shown to increase the accuracy of the subsequent recognition. We inspect thin-plate spline (TPS) and iterative closest point (ICP) based registration schemes under realistic assumptions on manual or automatic landmark detection prior to registration. We evaluate several approaches for the coarse initialization of ICP. We propose a new algorithm for constructing an AFM, and show that it works better than a recent approach. Finally, we perform simulations with multiple AFMs that correspond to different clusters in the face shape space and compare these with gender and morphology based groupings. We report our results on the FRGC 3D face database.
منابع مشابه
Registration of 3D Face Scans with Average Face Models
The accuracy of a 3D face recognition system depends on a correct registration that aligns the facial surfaces and makes a comparison possible. The best results obtained so far use a costly one-to-all registration approach, which requires the registration of each facial surface to all faces in the gallery. We explore the approach of registering the new facial surface to an average face model (A...
متن کاملMorphable Face Models - An Open Framework
In this paper, we present a novel open-source pipeline for face registration based on Gaussian processes as well as an application to face image analysis. Non-rigid registration of faces is significant for many applications in computer vision, such as the construction of 3D Morphable face models (3DMMs). Gaussian Process Morphable Models (GPMMs) unify a variety of non-rigid deformation models w...
متن کاملInferring 3D face models from 2D databases
Parameterized Appearance Models (PAMs) such as Active Appearance Models (AAMs) or Morphable Models (MMs) are a popular tool to model the shape and appearance of faces in images. Although extensively used, PAMs have some limitations to decouple out-of-plane pose, expression and identity changes. For instance, standard AAMs use a unique basis to model pose, identity and expression changes. On the...
متن کاملProcessing and analysis of 2.5D face models for non-rigid mapping based face recognition using differential geometry tools
This Ph.D thesis work is dedicated to 3D facial surface analysis, processing as well as to the newly proposed 3D face recognition modality, which is based on mapping techniques. Facial surface processing and analysis is one of the most important steps for 3D face recognition algorithms. Automatic anthropometric facial features localization also plays an important role for face localization, fac...
متن کاملApplications of 3D morphable models for faces with expressions
In this paper, we present a framework to represent the face of any individual, dealing with identity and expression variation and some applications of this model. A 3D morphable model (3DMM) is a generative method capable to reconstruct the 3D shape of human faces from a small set of coefficients. It is used in many applications such as identity or expression recognition, 3D scans processing or...
متن کامل